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Abstract. Consider the optimization problem of minimizing a polynomial 
function subject to polynomial constraints. A typical approach for solving 
it is applying Lasserre's hierarchy of semidefinite programming relaxations, 
based on either Putinar's or Schmudgcn's Positivstcllcnsatz. A practical ques- 
tion in applications is: how to certify its convergence and get minimizers? In 
this paper, we propose flat truncation as a general certificate for this purpose. 
Assume the set of global minimizers is nonempty and finite. Our main results 
are: i) Putinar type Lasserre's hierarchy has finite convergence if and only if 
flat truncation holds, under some general assumptions, and this is also true 
for the Schmudgen type one; ii) under the archimedean condition, flat trun- 
cation is asymptotically satisfied for Putinar type Lasserre's hierarchy, and 
similar is true for the Schmudgen type one; iii) for the hierarchy of Jacobian 
SDP relaxations, flat truncation is always satisfied. The case of unconstrained 
polynomial optimization is also discussed. 



(1.1 



1. Introduction 
Given polynomials f,gx,..., g m , consider the optimization problem 
min f(x) 



s.t. gi(x) > 0, . . . ,g m (x) > 0. 



Let K be its feasible set, and f m %n be its global minimum. The fc-th Lasserre's 
relaxation [B] for solving (jl.lj) is (k is also called the order) 

(1.2) max 7 s.t. f(x) - 7 £ Qk(g)- 

Here, the set Qk(g) denotes the fc-th truncated quadratic module generated by the 
tuple g := (gi,---,g m ) (for convenience, denote go = 1 and say a polynomial is 
SOS if it is a sum of squares of other polynomials): 



Qk(g) ■= E 



i=0 



<Ji is SOS, deg(gi<7i) < 2fc for every % 



The relaxation (|1.2|) is equivalent to a semidefinite programming (SDP) problem, 
and thus could be solved efficiently by numerical methods like interior point type 
algorithms. Let fk be the optimal value of (|1.2[) for a given order k. Clearly, 
every fk < f m in and the sequence {fk} is monotonically increasing. Under the 
archimedean condition (i.e., there exists <f> £ Qi{g) for some I such that the in- 
equality 4>(x) > defines a compact set in x), Lasscrre [6] proved a fundamental 
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result: fk — > fmin as fc — > oo. An estimation of its convergence rate is given in [12j . 
The sequence of f|1.2|) as k — > oo is also called Lasserre 's hierarchy in the literature. 
As demonstrated by extensive numerical experiments, it occurs quite a lot that 
fk = fmin for a finite order k in applications. If this happens, we say Lasserre's 
hierarchy has finite convergence. This raises a very practical question: since fmin 
is typically unknown, how do we certify its finite convergence if it happens? If it 
is certified, how do wc get minimizcrs? A frequently used sufficient condition for 
this purpose is flat extension introduced by Curto and Fialkow (cf. [3]), but it is a 
strong condition that might not be satisfied, i.e., it is not necessary. To the author's 
best knowledge, there is very few work on proving a general certificate for checking 
finite convergence of Lasserre's hierarchy, and the question is almost completely 
open. The motivation of this paper is to address this issue. Our main result is 
that a more general condition called fiat truncation could typically serve as such a 
certificate. 

1.1. Background. Typically, to extract a global minimizer, one needs to consider 
the dual optimization problem of (jl.2l) whose description uses localizing matrices. 
Define degree integers 

(1.3) di = [deg(ffi)/2] , d g = max{l, d lf . . . , d m }, d } = [deg(/)/2]. 

(Here \a~\ denotes the smallest integer that is greater than or equal to a.) Let 
y be a sequence indexed by a := (ai, . . . , a n ) € N n (N is the set of nonnegative 
integers) with \a\ := a\ + ■ ■ • + a n < 2k, i.e., y is a truncated moment sequence 
(tms) of degree 2k. Denote by J^2k the space of all tms whose degrees are 2k. A 
tms y £ ^#2fe defines a Riesz functional I£ y on R[a;]2fc (the space of real polynomials 
in x := (x\, . . . , x n ) with degrees at most 2k, and denote M[x] = as 




For convenience, denote x a := x" 1 ■ ■ ■ x" n ; if p(x) = ^2 a p a x a , we also denote 

{p,y) = J? y (p). 

The fc-th localizing matrix (y) generated by a polynomial h and a tms y S -M^h 
is a symmetric matrix satisfying (denote d^ — |~deg(/i)/2]) 

p T L^(y)p = J? y (h(x)p(x) 2 ), Vp(x) G R[x] k _ dh . 

On the left hand of the above, p denotes the coefficient vector of the polynomial 
p(x). When h = 1, L^(y) is called a moment matrix and is denoted as 

M k (y) :=L[ k \y). 

The columns and rows of L^\y), as well as Mk(y), are indexed by integral vectors 
a S N" with |a| < k - d h . 

The dual optimization problem of (|1.2[) is (cf. [6} [8]) 

{min (/, y) 
s.t. L ( £ ) (y)hO(i = 0,l,...,m), (l,y) = l. 

In the above, X y means a matrix X is positive semidefinite. Let be the 
optimal value of (|1.4[) for order k. By weak duality, ft < fk for every k. UK has 
nonempty interior, then (|1.4p has an interior point, (jl.2p achieves its optimal value 
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and /£ = fk, i.e., there is no duality gap between (|1.2[) and (|1.4[) (cf. |6j). Clearly, 
every < fmin, and the sequence {/£} is also monotonically increasing. We refer 
to Lasserre's book [5] and Laurent's survey [TU] for related work in this area. 
Suppose y* is an optimizer of (| 1 -4|) . If the flat extension condition (cf. [3]) 

(1.5) rankMfe_ da (y*) = rank A/ fc (j/*) 

holds (d s is from (|1.3p ). then we can extract r = rankMfe(j/*) global optimizers for 
|[0]> . By Theorem 1.1 of Curto and Fialkow [3], if y* is feasible for (fll} and (fT3|> 
is satisfied, then y* admits a unique r-atomic measure supported on K, i.e., there 
exist (Ai, . . . , A r ) > and r distinct points Vx, . . . ,v r € K such that 

(1-6) y* = Ai[ui]2k H V \ r [v r ]2k- 

Here, for x € K™, [x]2k denotes the vector defined as 

[ar] 2 fe := [l x\ ■■■ x n x\ Xix 2 ■■■ a£*] T . 

In (|1. 61) . the constraint (l,y*) = 1 implies Ai + • • ■ + A r = 1. If (|1.5p holds, then 
fk = fmin (suppose there is no duality gap between (|1.2[) and (|1.4p ), all V\, . . . , v r 
are global minimizcrs of (|l.ip , and they could typically be obtained by solving some 
SVD and eigenvalue problems, as shown by Henrion and Lasserre [5]- Generally, 
(|1.5p is a sufficient but not necessary condition for checking finite convergence of 
Lasserre's hierarchy 

For a tms z S ^2t, we say z is flat with respect to g if z is feasible in (jl.4p for 
k = t and satisfies rankM t _(j s (2;) = rankM t (z) (cf. [3]). If the tuple g is clear in 
the context, we just simply say z is flat. 

1.2. Flat truncation. To get a minimizer of (|l.ip from an optimizer y* of (jl.4p . 
the flat extension condition (jl.5p would be weakened. For instance, if y* has a /?ai 
truncation, i.e., there exists an integer £ e [max{d/, fc] such that 

(1.7) rankM t _ dg (y*) = rankM t (y*), 

then we would still extract r := rankAf t (?/*) minimizers for (jl.ip . Let z = j/*|2t 
(denote y*\^t '■— {vt, '■ \ a \ ^ 2t}) be the truncation. Then, the tms z is flat, and 
there exist r distinct points u\, . . . ,u r G K and scalars Ai, . . . , X r such that 

z = Ai[ui] 2t H h A r [u r ] 2t , 

Ai > 0, . . . , A r > 0, Ai H h A r = 1. 

Clearly, (f,z) = (f,y*) = /£ < /,„;„ (note 2< > dcg(/)) and 

Ai/(iii) H h X r f(u r ) = (f, z) = (f, y*) < f min . 

Since every f(iii) > f m im each u, must be a global minimizer of ([l.ip . Hence, if an 
optimizer of (| 1 .4[) has a flat truncation, then = f m i n , and /fc = / m m if there is 
no duality gap between (|1.2p and (|1.4|) . 

The rank condition (JTTTJ) was used in [51 [TU] as a sufficient condition to ver- 
ify exactness of Lasserre's relaxations in polynomial optimization and generalized 
problems of moments. When the feasible set K is defined by polynomial equalities 
fi(x) = ■■■ = f s (x) = and possibly polynomial inequalities, if the equations 
have finitely many zeros, then Lasserre's hierarchy has finite convergence (cf. [9j 
§3] or [lOj §6.5]), and for k big enough every tms y that is feasible for (|1.4p has a 
flat truncation (cf. [3 Prop. 4.6] or [10j Theorem 6.20]). For general polynomial 
optimization, there arc no such similar results in the existing literature. 
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As we have seen earlier, for an optimizer of (|1.4j) to have a fiat truncation, a 
necessary condition is fk = fmin (suppose (|1.2[) and (|1.4p has no duality gap). 
Thus, flat truncation is generally a sufficient condition for Lasserre's hierarchy to 
have finite convergence. Thus, one is wondering whether flat truncation is also 
necessary: if Lasserre's hierarchy converges in finitely many steps, does every 
optimizer of ()1 .4[) have a flat truncation? If so, flat truncation could be used as 
a certificate for checking its finite convergence and some minimizers of (|I.lj) could 
also be obtained. This issue was addressed very little in the field. 

Another important issue in applications is about asymptotic convergence of 
Lasserre's hierarchy. Under the archimedean condition, we know fk fmin as 
k — > oo (cf. [6]), but the convergence to the set of minimizers is not known very 
well. When (|I.Ij) has a unique global minimizer «*, Schweighofer [20j showed an 
important result: the subvector consisting of linear moments of a nearly optimizer 
of p.4p converges to u* as k — > oo. However, for the general case that (|I.II) has 
more than one global minimizer, there are no such similar results in the existing 
work, to the author's best knowledge. It is possible that = fmin for every fc, 
i.e., Lasserre's hierarchy may have no finite convergence, as implied by Schciderer's 
work |17j . In such cases, one should not expect any minimizer of (|I.4[) to have a 
flat truncation. However, how about the limit points of truncations of minimizers 
of (|I.4p as k — ► oo? Is every such limit point flat, or does it have a flat truncation? 
There is very few work on this issue. 

1.3. Contributions. This paper focuses on proving a certificate for checking con- 
vergence of Lasserre's hierarchy. We assume has a nonempty set S of global 
minimizers and its cardinality l^l is finite, which is generally true. Our main result 
is that flat truncation would generally serve as such a certificate. 

First, we study how to certify finite convergence. For Lasserre's hierarchy of 
(|1.2|) (it is also called a Putinar type one), we show that: it has finite convergence 
if and only if every minimizer of (|I.4j) has a flat truncation when k is sufficiently 
large, under some general conditions (see Assumption I2.l| ). For Schmiidgen type 
Lasserre's hierarchy, which is a refined version of (|1.2j) by using cross products of 
<7j (see (|2.6p ). we also show that generally it has finite convergence if and only if 
every minimizer of the dual problem (see (|2.7[0 has a flat truncation. This will be 
shown in Section [2l 

Second, we consider asymptotical convergence. Let {yW}^ be a sequence of 
asymptotically optimal solutions of (|1.4|) . We prove that: under the archimedean 
condition, for any fixed order t > m&x{df,d g + \S\ — 1}, the truncated sequence 
{y^\2t}kLi i s bounded, and its every limit point is flat, i.e., flat truncation is 
asymptotically satisfied for Putinar type Lasserre's hierarchy. A similar result holds 
for the Schmiidgen type one when K is compact. This will be shown in Section [3l 

Third, we consider the applications of the above results in unconstrained poly- 
nomial optimization and Jacobian SDP relaxations. For them, we show that flat 
truncation could be used as a certificate for checking finite convergence of the hi- 
erarchy of the SDP relaxations. This will be shown in Section [4] 



If ft = fmin and ll.lt has a minimizer, say x* , then 11.4t always has an optimizer that is 
flat, e.g., [a:*]2/fc. Thus, it is more sensible to ask whether every optimizer has a flat truncatioin. 
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2. Certifying Finite Convergence 

As we have seen in §1.2| flat truncation is generally a sufficient condition for 
Lasserre's hierarchy of (|f .2j) to converge in finitely many steps. In this section, we 
show that flat truncation is also generally a necessary condition. Thus, it could 
generally serve as a certificate for checking finite convergence of the hierarchy of 
(|f .2|) . Lasserre's hierarchy of (|f .2[) is also called a Putinar type one, since it uses 
Putinar's Positivstellensatz |16j in representing positive polynomials. A refining 
of (|f ,2|) is Schmiidgen type Lasserre's hierarchy, which uses cross products of the 
constraining polynomials. Similarly, flat truncation would also be generally used as 
a certificate for checking finite convergence of the Schmiidgen type one. We present 
the results in two separate subsections. 

2.f . Putinar Type Lasserre's relaxation. The quadratic module generated by 
the tuple g is 

oo 

Q(g) := |J Q k (g). 

k=l 

The archimcdean condition (AC) requires that there exists <fi G Q{g) such that the 
inequality 4>(x) > defines a compact set in x. Note that AC implies the feasible 
set K is compact. The convergence for Lasserre's hierarchy of (|I.2j) is based on 
Putinar's Positivstellensatz |16| : if a polynomial p is positive on K and AC holds, 
then p G Q(g)- To certify finite convergence of Putinar type Lasserre's hierarchy, 
we need the following general assumption on f,gi,..., g m . 

Assumption 2.1. There exists p G Q(g) such that for every J C {1, . . . , m) and 

V.j := {x G R" : g 3 (x) = (Vj G J), rankGj(x) < \J\}, 

the intersection Vj H A4 (~l V is finite. Here, denote J = {ji, . . . 

Gj(x):=[Vf(x) V 9jl (x) ••• V 9jl (x)}, 

and M := {x G R" : f{x) = f min }, P:={iel": p{x) > 0}. 

Assumption 12.11 requires that for every J the optimization problem 

min f(x) s.t. gj(x) = (j G J) 

has finitely many critical points lying on M. C\V (if u is a critical point of the above, 
then rankGj(w) < J|, cf. [131 §2]). Let S be the set of global minimizers of (|1.1[) 
and 

V := UjVj. 

Clearly, S C V, and Assumption 12.11 implies that S is finite. This assumption is 
very general, as one could see from below: 

• When every Vj is finite, which is true for general f,g\,...,g m (cf. [T31 
Prop. 2.1]), Assumption 12.11 could be satisfied by choosing p = 0. 

• Suppose S is finite, VCiM is infinite, but (VnM)\K belongs to a compact 
set T not intersecting K. Then, there exists S > such that 

dist(x, K) > 5Vx G T, dist(x, K) = Va; G K. 

(Here dist{x,K) = mh\ u ^K \\x — ii 1 1 2 and |j • ((2 denotes the standard 2- 
norm.) The function t(x) :— dist{x,K) — 5/2 is continuous in x. Then, 
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by the compactness of K and T, there exists a polynomial rj that is an 
approximation of r and satisfies 

r](x)>6/4\fxeT, r)(x) < —5/4 Vi £ K. 

Clearly, —rj is positive on K. Assume AC holds for g, then —r\ £ Q(g) by 
Putinar's Positivstellcnsatz. Assumption 12.11 could be satisfied by choosing 
p = —7/, because V C\ Mf^V = S is finite. 
• Suppose V n Ai is unbounded but, except finitely many points, lies on a 
real algebraic variety 

{x 6 W : wx(x) = ■ ■ ■ = w r (x) = 0} 

not intersecting K. Suppose AC holds for g, then K is compact and there 
exists e > such that the polynomial w := w\ + • • • + — e is positive 
on K . By Putinar's Positivstellensatz, w £ Q(g)- Assumption 12.11 could be 
satisfied by choosing p = w. 

Our main result of this subsection is the following theorem. 

Theorem 2.2. Suppose Assumption \2. 1\ holds, the set S of global minimizers of 
( [TUP is nonempty, and for k big enough the optimal value of Al.ty) is achievable and 
there is no duality gap between il.ty) and Ji.^[ ). Then, Lasserre's hierarchy of M.'0j) 
has finite convergence if and only if every minimizer of has a flat truncation 
for k sufficiently large. 

Remark 2.3. In Theorem l2.2[ 1) if K has nonempty interior, then for every order 
k (|1.2[) achieves its optimum, and it has no duality gap; 2) if finite convergence 
occurs, then (jl.4[) always has a minimizer for k big enough (e.g., [a;*]2fc is one for 
any x* £ S), and there is no duality gap; 3) when k is big enough, for every 
minimizer y* of (|1.4[) . 1 2fc— 2 is always flat, as shown in the proof later; 4) we did 
not assume K is compact or the archimedean condition holds. 

Remark 2.4. As pointed out in Laurent's survey [101 §6.6], we could get the 
following properties about flat truncation. 1) In Theorem 12. 2\ Assumption 12.11 
implies S is finite. If rank Mk{y*) is maximum over the optimizers of (|1.4j) . then 
for any flat truncation of y*, say, y*\2t, rankM t (y*) = This means that all 
the minimizers of (jl.ip could be extracted from y*\2t- 2) When S is infinite and 
rank A/fe(y*) is maximum over the optimizers of (jl.4p . then y* could not have a 
flat truncation. 3) When ()1.2[) and (|1.4[) are solved by primal-dual interior-point 
algorithms, a minimizer y* near the analytic center of the face of optimizers of 
(|1.4|) is usually returned and rankMfc(?/*) is typically maximum. Therefore, if the 
conditions of Thcorcm l2.2l arc satisfied, by solving a sufficient high order Lasserre's 
relaxation via interior point methods, then we could typically find all minimizers 
of (|1.1[) if S is finite, and flat truncation could not be satisfied if 5* is infinite. 

To prove Theorem 12. 2[ we need some properties about the kernels of moment 
and localizing matrices. Given a polynomial p(x), denote its coefficient vector by 

p. For a localizing matrix Lr£ (y), recall that if deg(/ip 2 ) < 2k then 

P T -L[ k \ y ).p = jZ y (hp>). 

If Lj^ (y) ■ p — 0, we say p £ ker (y) . When Mk(y) — L[ k \y) is a moment 
matrix , we similarly say p £ kerMfc(y) if Mk{y) ■ p — 0. 
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Lemma 2.5. Let y E ^ n ,2k, h E K[x] be such that L * (y) y 0. 

i) (THIIDIj Suppose M k (y) h 0. Le£ p, g E K[x]. If deg(pq) < k - I and 
q E kerM fc (y), tftera pg 6 kerM fe (y). If q l E kevM k (y) and 2\£/2] deg(g) < 
k — 1 , i/ien g 6 ker M k (y) ■ 

ii) Let s be an SOS polynomial with deg(hs) < 2k. Then, (hs,y) > 0. // 
(hs,y) = 0, £/ien /or any <f> E W.[x]2i with deg(hs) + 2£ < 2k — 2 we have 
(hs<p,y) = 0. 

iii) Let {pj}°^Li C M[x] be a sequence such that each deg(hp 2 ) < 2k and 

L h\y)'Pj^° as J->°o. 
If q £ R[x] and every deg(pjg) < fc — |~deg(/i)/2] — 1, £/ien 

lim 4%).(p i? ) = 0. 

iv) Lei {sj}|?;i be a sequence of SOS polynomials such that 

dcg(hsj) < 2k (Vj), and (hsj,y) — » as j — > oo. 
J/ <j> E R[x]2f and ewer?/ deg(hsj) + 21 < 2k — 2, then 
lim (hsj(j), y) = 0. 

Proof, i) The first part is basically from [TU1 Lemma 5.7] or [51 Lemma 21]. For 
the second part, if £ is even, the result follows Lemma 3.9 of [7]; if £ is odd, then 
q e+1 E kerMfc(j/) from the first part, and the result is still true. 

ii) By linearity of the Riesz functional J£ y {-) = (-,2/), we would generally assume 
s = p 2 is a single square. Then 

(hs,y) = (hp 2 ,y)=p T L (k) (y)p>0. 

Now, assume (hs,y) = 0. One could always write <fi = J^iQi ~ ^2jPj with all 
qi,Pj E M.[x]e. By the linearity of (•, y) again, we could further assume </> = g 2 is a 
single square. Note that 

(hp 2 , y) = p T L{ k \y)p, (hp 2 q 2 ,y) = (pqf L[ k \y)(pq). 

Since L^\y) ^ 0, (hs,y) = implies L^\y)p = 0. By Lemma 2.2 of [4], we also 
have L { *\y)(pq) = 0. Then (pq) T (y)(pq) = 0, i.e., {hscj>,y) = 0. 

iii) Let r = k — [~deg(ft)/2] . By a simple induction on dcg(g), it suffices to prove 
the lemma for q = Xi (1 < i < n). Note that every deg(pj) + 1 < r — 1. Let 

u^:=L^(y). Pj , v^:=L^(y).{p jq ). 
They are indexed by integral vectors a E N 71 , and could also be expressed as 

U« = Sg„ { Pj -h-[x] r ), = JZ y ( Xi -p r h> [X] r ) . 

Then vP' — > implies 




The a-th entry of v^> is 

: y :l (l> t -I'--'" ■■<:)■ 
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If deg(x Q ■ Xi) < r, then Va = u$, —> (5 is the exponent of x a ■ Xi). So, 

lim t#) =0 if |a| < r - 1. 

This implies (note (y) is a leading principal submatrix of L^\y)) that 

lim (l[ ) • (pj • x ? ) = lim ^(x, ■ p ■ h ■ [x] r _i) = 0. 

Since 1 (y) is symmetric, from the above, we know 

lim (pj • Xi) T ■ (if" (y)J ' (Pj • £i) = 0- 
When a | > r — 1, the coefficient of x a in the polynomial pj ■ Xi is zero. So 

(Pj • x 8 ) T • • (Pj • Xi) = (pj- • x,:) T • ^ fe_1) (2/)J • (pj • x,). 

Hence, we also have 

lim ( Pj ■ Xl ) T ■ [L^iy)) ■ (pj ■ x 4 ) = 0. 

Since L^\y) y 0, the above implies that 

lim (4 fc) (y))-(p J -Xi) = 0. 

iv) Write Sj = J2iP^ i (the length of summation is at most (™^ fc ), since dcg(sj) < 
2k). By part ii), (hsj 7 y) > (hp 2 - tl y) > 0. So, (hsj 7 y} — > implies 

(hpl e ,y)^(p j/ ) T L[ k \y)p J j 0. 

Since (y) >z. 0, we have L^\y)pjj —> as j —¥ oo. Like in item ii), we would 
also assume 4> = g 2 is a single square. By part iii), it holds that 

L h (v)(Pj,i9) ~> as j oo. 
This implies that (Pj,iq) T L^\y)(pj t iq) — > and 

(fo^.y) = ]T</^V,2/> = 5>i,rt) T 4%)(M) "> °- 

t i 

□ 

Proof of Theorem \ 2.2\ The sufficiency of flat truncation was observed in §1.2, 
if there is no duality gap between (|1.2[) and (|1.4[) . We only need to prove its 
necessity. Suppose fk a = fmin for fco big enough. Since (|1.2|) has a maximizcr 
when its order is big enough, we could assume (|1.2j) achieves its optimum f m i n for 
order fco (otherwise increase fco), i.e., /(x) — f m in G Qk a (g)- So, there exist SOS 
polynomials so, si, . . . , s TO such that every deg(gjSi) < 2fco and 

(2.1) / - fmin = «o + fflSi H h .g,„s m . 

Let y* be an arbitrary minimizer of (|1.4|) (it always has one when fc > fco, e.g., 
[x*]2fc, for any x* G 5). Clearly, (f,y*) = /mm- Let C be the semialgebraic set 
defined as (p is from Assumption 12. ip 

(2.2) C = {x G R" : *o(a:) - 5i(x)si(x) = •■• = g m (x)s m (x) = 0, p(x) > 0}. 
We complete the proof in three steps. 
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Step 1 We show that C is a finite set. In the identity (|2.1[) . differentiating its 
both sides in x results in (note go = 1) 

rn 
i=0 

Choose an arbitrary u G C, then clearly m 6 MnP. Let J(it) = {i : = 0}. 

Note that for every i £ J(u), s,(m) = 0, and it implies Vsj(u) = (because Sj is 
SOS and w is a minimizer of si). So, by the above, it holds that 

V/(«) = *(«) • Vfli(u). 
ieJ(«) 

Hence, u G Vjy„) nMn?. Since there are at most 2 m active index sets like J(u), 
by Assumption 12. 1[ C must be finite. 

Step 2 We show that every generator of the vanishing ideal of C belongs to the 
kernel of Mk(y*) for k big enough. Since C is finite, its vanishing ideal 

1(C) := {p E R[x] : p{u) = VueC} 

is zero dimensional. Let {hi, . . . , h r } be a Grobner basis of 1(C) with respect to 
a total degree ordering. Clearly, each hi vanishes on C. By Positivstellcnsatz (cf. 
Corollary 4.4.3 of pQ), there exist £ 6 N, 0i,...,0 m G R[aj], and v? G Q(p) (the 
quadratic module generated by the single polynomial p, which is also equal to the 
prepordering generated by p) such that 

hf- + ip + g\s\4>\ H h g m s m cj> m = 0. 

Applying the Riesz functional «5f a » to the above (suppose 2fc is bigger than the 
degrees of all the products there), we get 

m 

(2-3) (hf,y*) + +5>i«i&> if > = 0. 

i=i 

Applying Jz? y » to (JOJ results in (note (f,y*) = f min ) 

m 

(2.4) 0=(f-f min ,y*)=J2(9 j s j ,y*). 

3=0 

Since each Sj is SOS, every (gjSj,y*) > 0, by item ii) of Lemma 12.51 Thus, from 
the above, we know every (gjSj,y*) = 0. Again, by item ii) of Lemma 12. 51 if 
2k > 2 + deg(gjSj(j)j), then every (gjSj(pj,y*) = 0. So, from (|2.3j) . we can get 

(2.5) (h?,y*) + (<p,y*} = 0. 

Since hf e is SOS, we similarly have {hf e , y*} > 0. Since Q(p) C Q(5), y> G Q(g) and 
one could write ip = Y^j l =o9j a j with each <jj being SOS. Hence, 

(^y*) = (ffoo-o, y*} + (5101,2/*) + (g m a m ,y*) > 0, 

by item ii) of Lemma l2~5l Then (|2.5|l implies (hf e ,y*) = 0, i.e., /if G ker M k (y*). 
By item i) of Lemma |2~51 and Mk(y*) = (y*) ^ 0, if fc is big enough, we get 

fci G kerM fc (j/*). 
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Step 3 It's enough to show that y*\2k-2 is flat. Since C is finite, the quotient 
space R[x]/J(C) is finitely dimensional. Let be a standard basis of 

M.[x]/I(C). Then, for every a G N n , we can write 

r 

x a = 77(a) + ^T^Oihi, dcg(9 l h l ) < \a\, 77(a) G span{&i, . . . , b L }- 

i=l 

Because every hi G kerMfc(y*), we know 

Oihi 6 ker M fe (y*) if |a| < * - 1, 

by applying item i) of Lemma 12.51 Thus, 

x a - 77(a) G kcrAf fe (y*) if |a| < fc - 1. 

Set db := max,,- deg(6 3 ). Then every a-th column (db + 1 < \a\ < k — 1) of Mfc(y*) 
is a linear combination of /3-th columns of M^(y*) with |/3| < db, so 

rankM dfc (y*) = rankM t (?/*), t = d b + 1, . . . ,k - I. 

Hence, if k — 1 — d g > db, then 

rankM ft _i_d s (j/*) = rankAf fe _i(y*). 

That is, ?/*|2fc-2 is flat and 7/* has a flat truncation, when k is big enough. □ 

2.2. Schmiidgen type Lasserre's relaxation. Now we consider Schmiidgcn type 
Lasserre's hierarchy, which refines (|f -2j) as: 

(2.6) max 7 s.t. f(x) - 7 G Pr k (g). 

The above Prk(g) denotes the fc-th truncated preordering generated by the tuple g 
(denote g v := g" 1 ■ ■ ■ g%>): 



^e{o,i} m 



a v is SOS, dcg(<7„er„) < 2k for every v 



The dual optimization problem of (|2 .6[) is (cf. [Sj [Sj ) 
(2.7) 



mm (/, y) 

-(*)/ 



{ s.t. L£'(y)h0(ye{0,l} m ), (!,!/> = 1- 

Let /fc and /£ be the optimal values of (|2.6[) and (|2.7[) respectively, for a given 
order fc. By weak duality, /ft < for every fc. If K has nonempty interior, 
then fk = /£, i.e., there is no duality gap. Clearly, every /£ < frnin ■ Both 
sequences {/&} and {/^} are monotonically increasing. The relaxation (|2.6[) is 
stronger than (|1.2p . because Qk(g) Q P r k{g), so we have /ft < /ft for every k. By 
Schmiidgcn's Positivstellcnsaz (if K is compact and a polynomial p is positive on 
K, then p G Pre(g) for some ^, cf. [E]), then {/ft} converges to f m i n , and so does 
{/ft}, when if is compact. If /ftj = / m j„ for some order fci, we say Schmiidgen type 
Lasserre's hierarchy has finite convergence. 

Suppose 77* is an optimizer of (|2.7jl . If 77* has a flat truncation, say 77* 1 2* , then, as 
shown in §1.2, one could not only extract rank M t (y*) global optimizers of (|I.I[) from 
77*, but also get a certificate for /& = f m i n if there is no duality gap between (|2.6j) 
and (|2.7j) . So, flat truncation is also generally a sufficient condition for Schmiidgen 
type Lasserre's hierarchy to have finite convergence. Is it also generally a necessary 
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condition? If so, flat truncation would also serve as a certificate for checking finite 
convergence of the hierarchy of (|2.6[) . Like for the Putinar type one, this is also 
generally true. A similar result like Theorem 12.21 holds, and weaker conditions are 
required. 

Theorem 2.6. Suppose the set S of global minimizers of is nonempty and 

finite, and there is no duality gap between Ii2. 6]) and \2. 7| ) for k big enough. Then, 
Schmiidgen type Lasserre 's hierarchy of A2.6\) has finite convergence if and only if 
every minimizer of \2.1^ has a flat truncation for k sufficiently large. 

Remark 2.7. The comments in Remarks 12.31 and 12.41 for Theorem 12.21 are all 
applicable to Theorem 12.61 Here, we point out some differences: 1) Theorem 12.61 
does not require the optimum of (|2.6|) to be achievable. 2) Assumption ^. H is slightly 
stronger than that S is finite, although they are both generally true. 3) If it occurs 
that Qk(g) = Pfk{g) (e.g., this is the case when (jl.ljl has equality constraints 
and/or a single inequality constraint), then in Theorem 12.21 Assumption 12.11 could 
be replaced by \S\ < oo and (|1 .2[) is not required to achieve its optimum. 

Proof of Theorem ] 2.6\ Like in the proof of Theorem l2.21 we only need to prove the 
necessity of flat truncation. Suppose f kl = f m in for some order k\, then for every 
e > we have / - f min + e e Pr kl (g). Write 

(2.8) f-fmin + e= ]T o-l-g v 

w6{0,l}" 1 

for some SOS polynomials a% with deg(er^,<?„) < 1k\. Note that as e — > some 
coefficients of a\, might go to infinity while its degree is bounded. Let y* be an 
arbitrary minimizer of ()2.7j) (if k > hi, (|2.7|) always has one, e.g., [x*]2fc, for any 
x* e S). Then JS?„. (/) = f k = f mm . Applying J2f„. to we get 

(2-9) e= «9u,y*). 

Since every a\, is SOS, by item ii) of Lemma 12. 5[ {o~lg u ,y*) > and 
(2.10) lim«J„,9*)=0. 

We complete the proof in three steps. 

Step 1 The set S is finite, so its vanishing ideal 

7(5) = {c G R[x] : c(u) = VueS} 

is zero dimensional. Let {hi, . . . , h r } be a Grobner basis of I(S) with respect to a 
total degree ordering. Clearly, each hi vanishes on 

S={xe R" : -{f{x) - f mm ) = 0,gi(x) > 0, . . .,g rn (x) > 0}. 

By Positivstellensatz (cf. Corollary 4.4.3 of [T]), there exist £ € N, tp S M[x] and 
SOS polynomials (j) v (y e {0, l} m ) such that 

h f - (/ - fmin)<P + Y 4>ug V = 0. 
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Applying ££ y * to the above (suppose 2k is bigger than the degrees of all the above 
products) results in 

(2.11) (h?,y*)+ J2 (<l>»9u,y*) = ((f - f min )<P,y*). 

i^e{o,i} m 

By (|2.8j) . for every e > 0, we get 

(2.12) ((f-fmin + e)v,y*}= (9^lv,y*)- 

ue{o,i} m 

Step 2 By (|2.10p and item iv) of Lemma 12.51 we can get 

for k big enough. Hence, from (|2.12p and the above, it holds that 

((/ - /mm V, V*} = lim ((/ - fmin + e)tp, y*} = 0. 
e— >0 

So, (|2.11p results in the equality 

(hf,y*)+ (4>u9u,V*) = 0. 

i^e{o,i} m 

Since hf e and every <f> v are SOS, each {(j) v g v ,y*) > and (h? e ,y*) > 0, by item ii) 
of Lemma 12.51 Hence, (h^ e ,y*) = 0, i.e., h\ £ ker Mk(y*). Again, by item i) of 
LemmaOand M k (y*) = L<$(y*) h 0, if k is big enough, then 

tH G ker M k (y*). 

Step 3 Like Step 3 in the proof of Theorem 12.21 we would prove J/* 1 2fc— 2 is flat by 
repeating the same argument there, and omit it here for cleanness. □ 

3. Asymptotical Convergence 

In this section, we consider the general case that Lasserre's hierarchy of (|1.2p has 
asymptotic but not finite convergence. Under the archimcdean condition, Lasscrrc 
proved fu — > fmin as k — > oo. Since it is possible that ff. = < f min for 
every k, we should not expect flat truncation holds in such cases. When (|1.1[) 
has a unique global minimizer u* , Schweighofer |20j showed an important result: 
the subvector consisting of linear moments (indexed by a 6 N n with \a\ = 1) of 
an almost optimizer y^ of p.4[) for order k converges to u* as k —> oo. When 
has more than one minimizer, do we have a similar convergence result? To 
the author's best knowledge, this question was known very little. This section is 
addressing this issue. Generally, we need to use a higher order truncation of y^ k \ 
and consider its limit points. The main result of this section is that every limit 
point of a truncation of y^ is flat if (jl.ip has finitely many global minimizers. In 
other words, flat truncation is asymptotically satisfied for the general case. 

We assume the archimedean condition holds for the tuple g: there exist R > 
and fco £ N such that 



(3.1) 



FLAT TRUNCATION AND LASSERRE'S HIERARCHY 



13 



For a Borel set T C R™, denote by Prob(T) the set of all probability measures 
supported on T. Let S be the set of global minimizers of ([l.ljl . For each integer 
t > 0, denote 



(3.2) 



Fit ■= I J [xhtdfi : /i G Prob(S*)| 



Proposition 3.1. Let S and Fit be defined as above. IfO < \S\ < oo, then for any 
integer t > m&x{df,d g + \S\ — 1}, every tms z G F 2 t is flat. 

Proof. Let i = \S\ and write S = {(ai t i, • ■ • , ai, n ) : i = 1, . . . ,■£}, and 7 be the ideal 
generated by the following polynomial equations 

(x tl - ai,i 1 )(x i2 - a 2 ,i 2 ) ■ ■ ■ (x ie - ai iin ) = 0, Vii, . . . , it G {1, . . . , n}. 

Clearly, the zero set of the above equations is S. For each a G N n with \a\ = £, the 
x a is a leading monomial in one of the above defining polynomials, so there exists 
p a G R[a;]^_i such that 

(3.3) x a -p a {x) = mod I. 

Choose an arbitrary z G F 2 t, then there exists fi G Prob(S') satisfying 

[x]2tdn, M t {z) = / [x]t[x)fdfi. 
i Js 

By a simple induction on |a|, one could show that for every \a\ G [i,t], there exists 

p a G satisfying p.3[) . Clearly, a; Q — p a (x) vanishes on S and 

-Pa(^) G kerM t (z). 

This means that every a-th (|a| > £) column of M t (z) is a linear combination of 
its /3-th columns (|/3| < £ — 1). So, it holds that 

rank M e -x(z) = rankM r (z), Vr = 1,1 + 1, . . . , t. 
Thus, for all t > d g + i — 1, we have 

rank Mt-d g {z) = rank Mt(z). 
Clearly, every Lg/(z) >r 0, and hence z is fiat by the definition. □ 

Denote by the space of all full moment sequences w = (w a ) indexed by 
vectors a G N™. For all w, z G ^#oo, define 

(w, z) =^w a z a , \\w\\ 2 = \J (w,w). 

a 

This induces a Hilbert space 

•^lo = i w G ^oo : IMI2 < oo}. 
If we think of as a Banach space, then it is self-dual. Clearly, is equivalent 
to the optimization problem: 

J [xlaodfM : n G Prob(A') j . 
The set of its optimizers is precisely Prob(S'). 

Lemma 3.2. Suppose f3.1] ) holds. If y is feasible for {1.4]) and k > k\ > ko, then 

(3.5) ||y|2( fel - fc0 )ll2<i + fi + --- + ^ fel " fe0 - 



(3.4) min (f,y) s.t. y G 
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Proof. By (|3.1j) . there exist SOS polynomials so, si, . . . , s m such that 

m 

R - \\ x \\l = X! 5iSl ' cach de g(s* s «) < 2fc o- 

i=0 

(Here ||a;||2 : = \/ x \ + + Thus, for every j = 1, . . . , k\ — ko, we have 

m 
i=0 

Applying Jz? y to the above gives (by item ii) of Lemma I2.5|) 

RJ? y {\\x\\l j - 2 ) - ^(llxH^') > 0, j = 1, . . . , - ko. 

Therefore, it holds that 

Sf v (\\x\\l) < R, J? v Q\x\\$) <&,..., JSf y (|rf) < ff. 

The moment matrix Mfc(y) = y implies its submatrix M^-koiv) h 0. 

In the below, we denote by \\A\\p the Frobenius norm of a matrix A, i.e., ||^4||f = 
v / Trace(A T A). Recall that ||A|| F < Trace(A) if A X 0. Clearly, 

^ |2/ Q | 2 < ||M fcl _ fco (2/)||| < (Trace(M kl . ko (y))) 2 : 

|o|<2(fci-fc ) 

fci — fcg fei — feo k± — kQ 

Trace(M kl _ k0 (y)) = £ £ y Q < £ JSf v (||x||«) < £ JP. 

j=0 | Q |=2j j=0 j=0 

So, the inequality (|3.5j) is true. □ 

It is possible that (|1.4[) might not have a minimizer, i.e., the optimal value /? of 
(|1.4p may not be achievable (cf. [2DJ Example 4.8]). Thus, we consider an almost 
optimizer of (|1.4p . Let {y^} be a sequence such that y^ is feasible for (| 1 .4[) with 
order ft. We say {2/^} is asymptotically optimal if 

lmi(/,j/W)= hm 4*. 

k — >oo ft— >-oo 

(A different notion nearly optimality was used in [2D].) Note that if (|3.1[) holds and 
{y^} is asymptotically optimal, then (f,y^) —> fmin as ft — > oo. 

Theorem 3.3. Assume the archimedean condition \3. 1\) holds and the set S of 
global minimizers of is nonempty and finite. Let {?/*")} fr e asymptotically 

optimal for Then, for every t > max{(fy , <i g + |S| — 1}, the truncated sequence 

{y^ fe ^2t} is bounded, and its every limit point belongs to F%t and is flat. 

Proof. If we replace fti — fco by t in (|3 . 5|) of Lemma 1331 then the sequence {y^\2t} 
is clearly bounded. We could generally assume R < 1, because otherwise one can 
scale x in (|3.1|) so that i? < 1 and Lasserre's hierarchy remains equivalent. 

Let v be an arbitrary limit point of {?/*") | 2t } p One could generally assume 
y^\it — >• v. We need to prove v S -Fbt- Here we exploit a technique that is 
used in [5]. Suppose otherwise v £ F 2 t- For every ft, define 

Z W : = y (fe) |2(,-, )- 
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Each z^> could be treated as a vector in by adding zero entries to the tailing. 
So, for k > ko, the inequality (|3.5[) implies 



z 



(k) \\l <1 + R + R 2 + R 3 + ••• = 1/(1 -R). 



The sequence {z^} is bounded in By Alaoglu's Theorem (cf. [U Theo- 

rem V.3.1] or [51 Theorem C.18]), it has a subsequence {z^ kj ^} that is convergent 
in the weak-* topology. That is, there exists z* G such that 

(c, z^) -> (c,z*) as j -> oo 
for every c G If we choose c as (c, w) = w a for each a, then one could get 

(3.6) y^\ 2t = z^\ 2t ^z*\ 2t = «. 

Note that every L^(z^) h if fcj > 2r. By flU]), it holds that for all r 

4:V)^0, z = 0,l,...,m. 

Hence, z* € is a full moment sequence such that the corresponding localizing 
matrices of all orders are positive semidefinite. By Lemma 3.2 of Putinar |16j and 
(|3.ip . z* admits a probability measure (note _£? z »(l) = 1) supported on K, and it 
is feasible for (|3.4[) . The polynomial / defines a continuous linear functional acting 
on jK"^ as (/, w). By the weak-* convergence of z^ k ^ —> z*, it holds that 

</,**) = lim (f,z^) = lim </,?/^) = lim /* = f mm . 

J— fOO J— J-OO J — ► OG J 

The above last two equalities are because (|3.1|1 holds and the sequence {y' k '} is 
asymptotically optimal. This means that z* is also a minimizer of (|3.4|) . Hence, 
v = z*\ 2t G i^t- But, this contradicts the earlier assertion that v $ F 2t . Therefore, 
every limit point of {y^\ 2 t} belongs to F 2t . By Proposition 13.11 we know every 
v G F 2t is flat if t > max{d f , d g + \S\ - 1}. □ 

In Theorem 13.31 for a fixed t, it is possible that the truncation y^\ 2 t is not flat 
for every k. But, for every e > 0, if k is big enough, there exists a z G i 7 ^* such 
that H?/^^* — z\\ 2 < e. In other words, flat truncation is asymptotically satisfied 
when S is finite. Theorem 13.31 also implies that the distance between y^\ 2 t and 
F 2t tends to zero as k — > oo. Therefore, in numerical computations, flat truncation 
has a good chance to be satisfied. 

Remark 3.4. A similar version of Theorem 13.31 also holds for Schmiidgen type 
Lasserre's hierarchy. This is because (|2.7p can be thought of as a Putinar type one 
applied to the 2™ constraints g v (x) > {y G {0, l} m ). The archimedean condition 
(|3.ip for the corresponding constraints is automatically satisfied for compact K, 
by Schmiidgen's Positivstellensatz. Hence, when K is compact and S is finite, flat 
truncation is also asymptotically satisfied for the hierarchy of (|2.7[) . 



4. Some Applications 

In this section, we consider two interesting cases of semidefinite programming 
relaxations for solving polynomial optimization, for which flat truncation would 
serve as a certificate to check finite convergence and be used to get minimizers. 
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4.1. Unconstrained polynomial optimization. Consider the unconstrained poly- 
nomial optimization 

(4.1) min f(x). 

To have a finite minimum f m im assume f(x) has an even degree 2d. The standard 
SOS relaxation (cf. 0[T5]) for solving p~Tj) is 

(4.2) max 7 s.t. f(x) - 7 is SOS. 
Its dual optimization problem is 

(4.3) mm (f,y) s.t. M d {y) h 0, (1, y) = 1. 

Lasserre [6] showed that (|4.2[) and (|4.3[) have the same optimal value (there is no 
duality gap), which we denote by / sos , and (|4.2[) achieves its optimum if / sos > — 00, 
because (|4.3p has an interior point. Clearly, f sos < f m i n . As demonstrated by the 
numerical experiments of |15j . it occurs quite a lot that f m in = f SO s- Thus, one is 
wondering: how do we check / sos = f m im and if so how do we get minimizers of 
(|4.1[) ? This issue could be solved by using flat truncation. 

The whole space W 1 would be defined by the trivial inequality 1 > 0. Thus, the 
associated fc-th truncated quadratic module and prcordering coincide and 

Q fe (l) = Pr k (l) = E n , 2fc , 

where X n .2fc denotes the cone of SOS polynomials having n variables and degree 
2k. Like (|1.2[> and (|1.4[) . the k-th order Lasserre's relaxation for (|4. 1[) is 

(4.4) max 7 s.t. f(x) - 7 e £ n ,2fc, 
and its dual optimization problem is 

(4.5) mm (f,y) s.t. M k (y) h 0, (1, y) = 1. 

Clearly, for every k > d, (|4.4[) is equivalent to (|4.2j) . However, (|4.5j) and (|4.3[) arc 
different in satisfying flat truncation, though they have the same optimal value. 
Theorem 12.61 implies the following. 

Corollary 4.1. Let f sos be the optimal value of l{4.2ty . Suppose f m i n = f sos cind 
J^.i[ ) has a nonempty set of finitely many global minimizers. Then, for k big enough, 
every minimizer y* of |^.5[ ) has a flat truncation. 

If y* is an optimizer of (|4.3[) instead of (|4.5|) . then y* might not have a flat 
truncation. In this sense, (|4.5p is stronger than (|4.3[) . though their optimal values 
are same. If f m in > —00, then f(x) generally has finitely many minimizers, as 
shown in [13j Prop. 2.1]. 

4.2. Jacobian SDP relaxation. Now we consider the Jacobian SDP relaxation 
for solving polynomial optimization introduced by the author in the earlier work 
[2] . It is a refining of relaxation (|2.6I) . Its basic idea is to introduce some redundant 
polynomial equalities, say, 

<pi(x) = •■■ = <Pl{x) = 0, 

which are constructed from the minors of the Jacobians of f{x),g\{x) 1 . . . ,g m {x). 
For instance, when (|l.ip has a single inequality constraint, say g{x) > 0, the newly 
introduced equalities are 

g(x) ■ fxi(x) = 0, i = l,...,n, 
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(/*< ( X K- W " /*j (*)) =0,^ = 3,...,: 

l<i<j<n,i+j=£ 

When ([l.ljl achieves its minimum and some general nonsingularity condition (see 
Assumption 2.2 of [14]) holds, (| 1 . 1 j) is equivalent to 



(4.6) 



min fix) 



s.t. <pi(x) = ■ ■ • = v>l(x) = 0, 
ffi(x) > 0, . . . ,g m (x) > 0. 

Let PJk denote the fc-th truncated preordering for (|4.6|l (cf. [21 Sec. 2.2]). Then, 
the resulting version of relaxation (|2.6[) for (|4.6p is 

(4.7) max 7 s.t. /(a;) - 7 £ PJ fc . 

Similarly, its dual optimization problem is (cf. [14[ Sec. 2.2]) 

min (/, y) 

(4-8) I s .t. lg ) ( S )=0,j = l,...,L, 

4?(y)ho(v^e{o,in, (1,2/) = 1. 

An attractive property of the hierarchy of (|4.?p is that it always has finite con- 
vergence. Thus, a practical concern in applications is: how does one identify its 
finite convergence? Interestingly, flat truncation could serve as a certificate for this 
purpose when has finitely many minimizcrs. 

Corollary 4.2. Suppose hl.l)) has a nonempty set of finitely many global minimiz- 
ers and its feasible set is nonsingular (Assumption 2.2 of [14) is satisfied). Then, 
for all k big enough, the optimal value of 7[ ) equals the global minimum of 
and every minimizer of has a flat truncation. 



Proof. As before, denote by fk the optimal value of (|4.7|) . By Theorem 2.3 of |14j . 
there exists k\ such that fk t is equal to the global minimum of (|4.6I) . which is also 
equal to f m in, when Assumption 2.2 of [M] is satisfied. So, there is no duality gap 
between (|4.7|) and (|4.8[) when k is big. Clearly, (|4.6j) also has finitely many global 
minimizcrs, since it is equivalent to (jl.ll) . Thus, the conclusion of this corollary 
just follows Theorem 12.61 □ 



In particular, if a polynomial has finitely many global minimizers in the whole 
space K™, then its minimizers would be obtained by using gradient SOS relaxation 
[TT] . which is a special case of Jacobian SDP relaxation (see Corollary 2.6 of [14]). 
Its dual version of (14.81) becomes 



min (/, y) 

(4-9) \ s .t. Lfiy)=0,j = l,...,n, 

M k (y)h0, (l,y) = l. 
Hence, we would also get the following. 

Corollary 4.3. Suppose a polynomial f{x) has finitely many global minimizers in 
W 1 . Then, for all k big enough, the optimal value of |^.ff[ ) equals the global minimum 
of f{x) in W 1 , and its every minimizer has a flat truncation. 
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